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The  Discrimination  of  Graphical  Elements 


J.  G.  HOLLANDS1  *  and  IAN  SPENCE2 
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'University  of  Toronto,  Canada 


SUMMARY 

A  model  is  proposed  to  account  for  how  people  discriminate  quantities  shown  in  pie  charts  and 
divided  bar  graphs  tic  which  prnpoiluin  is  larger,  A  ni  H'A  I  he  m<  lemcnhd  eslnnnlinn  model 
assumes  that  an  observer  sequentially  samples  tiom  the  available  peiceptual  Sealures  in  a  graph  I  he 
relative  effectiveness  of  sampled  perceptual  features  is  represented  by  the  spread  of  probability 
distributions,  m  the  manner  of  signal  detection  theory.  The  model’s  predictions  were  tested  in  two 
experiments.  Participants  took  longer  with  pies  than  divided  bars  and  longer  with  non-aligned  than 
aligned  proportions  in  Experiment  1  In  Experiment  2,  participants  took  longer  with  divided  bars 
than  pies  wheii  graphs  were  of  unequal  size.  Generally,  graphical  formats  producing  longer  response 
times  incurred  a  greater  time  penalty  when  the  difference  between  proportions  was  reduced.  These 
results  were  in  accordance  with  the  model’s  predictions  Implications  for  graphical  display  design 
are  discussed.  Copyright  ©  2001  John  Wiley  &  Sons,  Ltd. 


INTRODUCTION 

Whose  market  share  is  larger  -  Ford  or  GM?  Who  sold  more  albums  in  CD  format  in 
1999  -  Shania  Twain  or  Celine  Dion?  We  often  ask  ourselves  such  questions  as  we  scan 
graphs  shown  in  newspapers,  tn  magazines,  or  on  the  Internet.  Discriminating  quantities 
shown  in  graphs  -  determining  which  of  two  quantities  ts  larger  -  is  a  fundamental  graph¬ 
reading  activity  (Kosslyn,  1993,  Simkin  and  Ilastic,  1987;  Spence  and  Lewandowksy, 
1991),  and  perhaps  the  most  common  task  people  perform  with  graphs.  Discrimination 
may  also  be  involved  in  more  complex  graph  reading  tasks  (see  Carswell,  1992;  Hollands 
and  Spence,  1992,  for  task  descriptions)  It  is  important,  therefore,  to  understand  the 
psychological  processing  that  underlies  how  quantities  are  discriminated  in  graphs.  In  this 
paper,  we  propose  a  processing  model  that  predicts  when  discrimination  of  graphical 
elements  should  be  more  difficult,  test  those  predictions  in  two  experiments,  and  discuss 
the  implications  of  the  results  for  the  design  of  graphical  displays 

Discnmmation  of  graphical  elements  is  not  as  straightforward  as  might  appear  at 
first  glance.  Examine  the  eight  pairs  of  graphs  (pies  and  divided  bars)  shown  at  the  top  of 
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Figure  1  An  illustranon  ot  the  decision  model  as  applied  to  aligned  and  non-aligned  segments  used 
in  Experiment  1  See  text  for  details 


each  panel  in  Figutes  I  and  2  For  each  pair,  ask  yourself-  Winch  shaded  tegion 
depicts  the  larger  proportion,  A  ot  13?  You  will  probably  lind  that  some  of  the  pairs 
ate  more  difficult  to  discriminate  than  others  We  note  five  impoitant  propei ties  of 
these  situations 

First,  the  observer  has  a  choice  of  perceptual  cues  or  features  to  make  the  decision, 
angle,  area  or  slope  with  pie  charts,  bar  top  position,  area,  or  height  with  dsvided  bars. 
Second,  as  the  above  example  illustrates,  the  available  perceptual  features  vary  across 
giaph  types.  Thud,  peiceptual  tcutuics  .tie  likely  to  vaiy  m  teimxol  then  clleclivcness. 
lengths  being  more  effective  than  angle,  for  example.  Fourth,  available  perceptual 
features  change  when  quantities  aie  depicted  in  different  positions  (Figure  1)  or  with 
different  scaling  (Figure  2),  and  the  task  subjectively  appears  more  difficult.  The  former 
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Figure  2  An  illustration  of  the  decision  model  as  applied  to  equal-size  and  unequal-size  pies  used  in 
Experiment  2  See  lexl  far  details 


situation  occurs  when  the  position  of  a  graphical  element  corresponding  to  one  variable 
changes  from  graph  to  graph,  usually  because  another  variable  also  changes  (eg 
because  Ford’s  market  share  increased  from  one  year  to  the  next,  the  position  of  the 
elements  representing  GM’s  market  share  is  shifted  up  in  a  divided  bar  graph,  or 
clockwise  in  a  pie  chart)  The  latter  situation  (Figure  2)  occurs  because  the  size  of  a 
single  divided  bar  or  pie  can  be  used  to  show  changes  in  total  amount  (e.g  to  indicate 
(hat,  m  total,  more  CDs  were  sold  in  I  999  than  in  1998).  Finally,  there  are  situations 
where  different  cues  provide  contradictory  information,  and  this  seems  to  make  the 
decision  particularly  difficult  Note,  for  example,  that  for  the  pie  charts  on  (he  right  of 
Figure  2,  angles  indicate  that  A  >  B,  whereas  areas  indicate  that  A<B  In  the  next 
section  we  shall  describe  a  model  (hat  takes  these  five  properties  of  the  situation  into 
account 
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THE  INCREMENTAL  ESTIMATION  MODEL 

There  is  a  large  lueiatuie  examining  perceptual  disci iimnauon  dating  back  to  the 
ptoneeiing  wotk  of  Fechnei,  and  llieie  are  good  theoietical  models  of  liovv  the  dis¬ 
crimination  process  works,  most  taking  a  signal  detection  approach  (e.g.  Penusic,  1992, 
Vickers,  1980)  Nonetheless,  these  models  cannot  propeily  account  for  the  discrimination 
of  data  shown  in  graphs  because  theie  are  seveial,  sometimes  redundant,  perceptual 
featuies  that  can  be  judged  with  most  graph  types,  as  noted  above.  In  addition,  data 
shown  in  graphs  are  often  expressed  as  piopoitions  or  peicenlages  (eg  inaiket  share) 
and  thus  a  common  task  for  the  graph  leadei  involves  the  discrimination  of  proportions 
rather  than  absolute  amounts  Simple  perceptual  discmnination  cannot  lead  to  accurate 
performance  when  the  overall  size  of  one  graph  is  changed  relative  to  the  other  (as  in 
Figure  2).  It  is  unclear  how  existing  models  of  perceptual  discrimination  could  deal  with 
this  situation. 

The  incremental  estimation  model  to  be  described  here  accounts  for  the  discrimination 
of  proportions  by  proposing  that  the  five  properties  affect  both  the  internal  representation 
of  the  difference  and  how  that  representation  changes  over  time  as  perceptual  features  are 
repeatedly  sampled  The  modelled  internal  representation  can  then  be  used  to  derive 
specific  predictions  that  can  be  tested  experimentally. 

Consider  the  two  pie  charts  A  and  B  shown  at  top-left  of  Figure  1.  We  have  depicted 
proportion  A  as  being  laiger  than  proportion  B,  without  loss  of  generality  The 
participant’s  task  is  to  respond  with  a  key  press  to  the  question.  ‘Which  proportion  is 
larger,  A  or  B?’  The  decision  process  may  be  described  by  a  two-alternative  forced- 
choice  (2AFC)  signal  detection  model  (Gieen  and  Swets,  1966;  Macmillan  and 
Creelman,  1991,  Chapter  5).  This  approach  to  modelling  the  discrimination  process 
has  its  origins  in  the  work  of  Thurstone  (1927)  and  since  then  similar  models  have 
often  been  used  to  account  for  peiformance  in  discrimination  tasks  (e.g.  Ashby, 
1983;  Link  and  Heath,  1975;  Petrusic,  1992;  Pike,  1973;  Smith  and  Vickeis,  1988; 
Treisman  and  Wads,  1966;  Vickeis,  1980)  Although  the  llieoiy  of  signal  detection  has 
seen  limited  application  in  the  giaplucal  petception  hteratuie  (Legge  et  al.,  1989; 
McEwan,  1994),  it  has  not  been  applied  to  the  discrimination  of  proportions  as 
examined  here 


Perceptual  features 

When  comparing  A  with  B  using  the  pies  on  the  upper-left  of  Figure  1,  an  observer 
may  choose  to  attend  to  a  feature  sucli  as  angle  and  estimate  the  difference  in  the  two 
angles.  Many  sources  of  error  will  impose  a  probability  distribution  on  the  observer’s 
estimate  of  the  difference  in  angle  (A-B)  We  assume  this  difference  distribution  to  be 
Gaussian.  In  die  top-left  panel  of  Figure  1,  the  true  difference  in  propoitions  is  4%  and 
the  slandaid  deviation  of  the  disti lbution  is  4%,  both  values  aibilianly  chosen 
tor  illustration.  The  shaded  portion  to  the  left  of  the  criterion  repiesents  the  probability 
of  a  decision  error  On  a  given  trial,  the  observei  samples  fiom  the  idifference 
distribution  (A-B)  and  depending  on  the  magnitude  of  the  sample  and  the  location 
of  the  criterion  the  decision  will  be  ‘A  <  B’  or  ‘A  >  B’  The  ‘correct’  distribution  is 
shown  using  a  solid  line  and  an  ‘incorrect’  dislubulion  [corresponding  to  the  case 
when  E  (A— B)  =  —  4%]  by  a  dashed  line  The  ciitenon  is  set  at  (A— B)  =  0,  a  neutral 
criterion,  which  is  typical  in  the  2AFC  paradigm  (Macmillan  and  Creelman,  1991) 


Copyright  ©  2001  John  Wiley  &  Sons,  Lid 


Appl  Cognit  Psychol  15'  4 13^13 1  (2001 ) 


P516831.PDF  [Page:  7  of  22] 


Discriminating  graphical  elements  417 


Table  1  A  hierarchy 
graphs  (see  Cleveland, 

of  perceptual  features  for  discriminating  proportions  in 
1985) 

Accuracy 

Perceptual  feature 

Most  accurate 

Position  along  a  common  scale 

Position  along  identical,  non-aligned  scales 

1  .cnglli 
.Slope 

Angle 

Area 

Volume 

Least  accurate 

Color  liue-saturalion-density 

With  a  larger  difference  between  the  true  pioportions,  the  observer’s  estimate  of 
difference  (A-B)  is  faithcr  from  0  on  average  In  other  words,  the  Leiilie  of  (lie 
difference  distribution  is  farther  from  the  critenon,  and  the  probability  of  a  decision 
error  decreases. 

In  addition  to  angle,  the  observer  could  base  the  judgment  of  difference  on  area  or  -  if 
the  segments  are  aligned  -  the  slopes  of  the  non-aligned  radii.  The  variances  of 
distributions  corresponding  to  different  features  would  differ  if  some  perceptual  features 
were  more  effective  at  conveying  quantity  than  others.  Cleveland  (1985)  has  ordered 
seveial  perceptual  featuies  used  in  graphs  (c  g  length,  angle,  area)  in  terms  of  then 
accuracy.  Cleveland  ranked  angle  and  slope  as  being  about  equally  effective  However, 
recent  studies  have  shown  that  angle  discrimination  is  less  accurate  than  slope  dis¬ 
crimination  (e  g  Regan  et  at.,  1996,  Smppe  and  Koenderink,  1994)  and  we  have  modified 
Cleveland’s  ranking  to  reflect  this,  as  shown  in  Table  1 

Cleveland’s  tanking  is  based  on  a  task  in  which  participants  estimated  the 
proportion  one  graphical  element  was  of  another  (e  g  what  percentage  is  A  of  B7). 
As  such,  the  task  involved  estimating  relative  magnitude.  It  is  an  empirical  question 
whether  Cleveland’s  ranking  is  effective  for  other  graph-reading  tasks,  such  as  dis¬ 
crimination  In  this  paper  we  test  Cleveland’s  ranking  (Table  1)  for  the  discrimination  of 
proportions'  Are  lugher-ianking  perceptual  features  associated  with  smaller  estimation 
errors7 

We  propose  that  an  observer  discriminating  two  proportions  will  sample  from  the  set  of 
available  features  -  on  one  occasion  concentrating  on  angle,  on  another  area,  and  so  forth 
'[he  accuracy  with  which  the  observer  computes  (A-B)  is  apt  to  vary  if  different  features 
are  attended  to  and  thus  the  overall  difference  distribution  will  be  a  mixture  of 
distributions,  all  of  which  have  the  same  positive  expectation  but  possibly  differing 
spreads  For  simplicity  we  assume  this  mixture  of  Gaussians  with  equal  expectations  to  be 
approximately  Gaussian  1 

In  the  two  next  sections  we  detail  the  situations  where  graphical  elements  are 
aligned  and  not  aligned,  respectively,  for  both  pies  and  divided  bars  Following  that, 
we  examine  the  situation  where  the  overall  size  of  one  graph  is  different  from  the 
other 


1  The  mixture  of  Gaussians  with  differed!  variances  wifi  be  more  plalykurtic  than  a  comparable  Gaussian  This 
fattening  of  the  tails  does  not  alter  the  predictions  of  our  model 
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Aligned  segments 

Pies 

In  the  top-left  panel  of  Figuie  I,  all  fealuics  that  indicate  the  magnitudes  of  the  two 
propoitions  ate  in  accoid  If  piopoition  A  >  B,  then  slope  A  >  B,  angle  A  >  13,  and  atea 
A  >  B.  In  the  absence  of  errors  of  estimation,  the  observer  will  come  to  the  same  coriect 
conclusion  and  tespond  ‘A  >  B',  independent  of  the  fealme(s)  used  to  make  the  judge¬ 
ment.  In  the  presence  ofeiror,  the  observer  samples  from  the  dilfetence  distubution  (A-B) 
and  makes  the  decision  ‘A<B’  ot  ‘A>B’.  The  acetuacy  of  diflerent  features  will 
vary  from  most  accurate  to  least  accurate  in  the  following  older  slope,  angle,  area 
(see  Table  1).  Although  the  optimal  feature  for  the  obseiver  to  attend  to  is  slope,  we 
assume  that  the  obseiver  samples  from  the  set  of  available  perceptual  features.  We  test  this 
assumption  later 

Divided  bars 

Consider  two  divided  bars  A  and  B,  with  shaded  areas  representing  two  proportions  as 
shown  at  bottom-left  in  Figure  1.  As  with  pies,  the  observer  samples  from  the  difference 
distribution  and  decides  ‘A  <  B’  or  ‘A  >  B’  If  the  segments  aie  aligned,  and  proportion 
A  >  B,  as  shown,  then  (bar  top)  position  A>B,  length  A>B,  and  area  A>B  An 
observer  can  judge  position  on  a  common  scale  with  divided  hais  but  cannot  with  pies  On 
average,  perceptual  lealuies  for  pies  rank  lower  in  the  fable  1  lueiaichy  Ilian  those  for 
divided  bars  and  therefore  the  variance  of  the  mixture  of  distributions  of  difference  should 
be  greater  with  pies  than  divided  bais  (as  illustrated  in  Figure  1)  This  should  result  in 
gt eater  erior  for  aligned  pies  than  aligned  divided  bars 


Non-aligned  segments 
Pies 

Consider  the  two  pies  at  upper  right  in  Figure  1  If  the  two  segments  are  not  aligned  the 
obseiver  can  no  longei  disci  mini. itc  on  llic  basis  ol  slope  Hence  the  vanance  ol  the 
probability  distribution  for  non-aligned  pie  chatts  will  be  greater  than  for  aligned 
pie  charts,  since  the  former  lacks  the  htgh-ianking  slope  feature  Thus  decision  ertois 
will  be  more  probable  with  non-aligned  than  with  aligned  segments.  Also,  the  error  rate  tor 
non-aligned  proportions  will  decrease  moie  rapidly  as  (A-B)  is  increased,  since  the 
probability  of  a  decision  enoi  decieases  mine  i.ipidly  as  a  Gaussian  disli ibuiiou  with 
larger  spread  is  shifted  to  the  light  2 

Divided  bars 

Position  along  a  common  scale  (as  occuis  with  bars  whose  bases  are  aligned  on  a  common 
axis)  ranks  highest  in  the  Table  1  hierarchy.  However,  if  the  two  segments  are  not  aligned, 
as  m  the  bottom-right  j>anel  of  Figuie  1,  the  position  feature  is  no  longer  available,  the 
observer  must  judge  length  oi  area  The  vanance  ot  the  mixtuie  difference  distribution  will 
be  larger  and  the  probability  of  a  decision  error  correspondingly  greatei.  As  with  pies,  and 
for  the  same  reason,  differences  in  decision  error  when  judging  aligned  and  non-aligned 
segments  will  be  smaller  with  larger  diffetences  in  the  pioportions  A  and  B 

2  Tins  statement  is  correct  when  eiroi  rales  .ire  small  In  our  experiments  pailicipanls  were  instructed  to  he  ;is 
dccui »ile  ds  possible,  hence,  enoi  idles  weie  siiidll  ( ’on  sequent  I  y  (lie  cum  idle  should  iJecie.ise  moie  iapulty  as 
(A-B)  is  increased  when  the  dilfetence  distributions  have  greatei  variability 
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Fie i  versus  divided  hats 

7  he  variability  of  the  diffcicncc  disti  ihulinn  shouhl  he  greater  loi  non-aligned  pies  than  for 
non-aligned  divided  bars,  since  the  available  features  (angle,  area)  tank  lower  on  aveiage 
than  those  for  non-aligned  divided  bars  (length,  aiea)  Thus,  the  probability  of  a  decision 
erior  should  be  greater  with  non-aligned  divided  bars  than  non-aligned  pies  Differences  in 
decision  error  between  non-aligned  pies  and  divided  bars  should  decrease  as  the  difference 
in  proportions  increases,  given  the  greater  variability  in  the  difference  distribution  for  non- 
aligned  pies 

In  the  next  section  we  consider  the  discrimination  process  when  pairs  of  pies  and 
divided  bars  ate  not  equal  m  size 


Overall  size 
Pies 

If  the  pies  are  not  equal  in  size  all  features  may  not  yield  the  same  sign  for  (A-B) 
Consider  the  two  pie  chaits  shown  in  (lie-top  light  panel  of  Figure  2  In  t lie  absence  of 
error,  comparing  slopes  or  angles  will  produce  the  coirect  response  ‘A  >  B’,  but 
computing  areas  will  produce  an  incorrect  response  of  ‘A  <  R’  Note,  however,  that  this 
will  not  always  be  the  case.  If  proportion  B  were  reduced  to  1 1%,  for  example,  A  would 
now  be  greater  than  B  for  areas  as  well  Thus,  even  though  unequal  sizes  will  increase  the 
likelihood  of  error  when  areas  are  compared,  sometimes  a  comparison  of  areas  will  yield 
the  correct  response. 

In  the  top  right  panel  of  Figuie  2,  we  show  the  distributions  that  would  result  if  the 
observer  attends  to  angle  75%  of  the  time  and  area  25%  of  the  time,  resulting  in  a  mixture 
of  Gaussians  One  Gaussian  has  a  positive  and  the  other  a  negative  expectation,  producing 
an  asymmetric  mixture  distribution  The  shape  of  the  mixture  would  change  according  to 
the  probabilities  of  attending  to  different  features  For  example,  the  shape  of  the  difference 
distribution  for  an  observer  who  attended  to  slope  60%,  angle  30%,  and  area  10%  of  the 
time  would  be  somewhat  different  However,  regardless  of  such  variation,  the  important 
point  is  that  if  the  observer  attends  to  a  contradictory  feature  some  of  the  time  the 
difference  distribution  will  no  longer  be  symmetrical  because  some  of  its  probability  mass 
will  be  shifted  to  the  ‘wrong’  side  of  (he  distribution 

Thus  the  difference  in  the  probability  of  error  between  equal  and  utiequai-size  cases  can 
be  considerable.  If  the  difference  (A-B)  is  increased,  the  expectation  of  the  difference 
distribution  moves  away  from  the  criterion,  just  as  in  the  equal-size  case.  Unlike  in  the 
equal-size  case,  the  variance  also  changes  since  there  is  a  component  of  the  mixture  on  the 
‘wrong’  side  of  the  criterion  Although  we  have  shown  this  component  with  location  at 
about  —4%,  the  positioning  of  such  a  component  will  depend  on  the  perceived  difference 
in  proportion  associated  with  the  attended-tn feature  As  the  true  difference  in  proportions 
increases,  the  component  on  the  ‘wrong’  side  will  not  necessarily  move  in  mirror  fashion 
to  the  componcnt(s)  on  the  ‘correct’  side  The  consequential  effect  is  that  the  overall 
variance  of  the  difference  distribution  is  increased  when  contradictory  features  aie 
attended  to 

However,  when  there  is  a  sufficiently  large  difference  between  the  proportions  A  and  B 
in  the  unequal-size  case,  the  problem  of  contradictory  features  goes  away  Consider  the 
top-right  panel  of  Figure  2  (33%  in  A  and  29%  in  B)  and  assume  that  the  observer  uses 
either  angle  or  area  to  make  (lie  decision.  Angle  yields  the  correct  decision  whereas 
area  misleads  Imagine  again  that  the  propoition  in  B  is  reduced  to  11%  thus  increasing 
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the  difference  in  propoi lions  to  22%  Irom  4%.  Attending  to  either  angle  or  aiea  will  yield 
the  correct  decision  since  the  shaded  aiea  in  B  will  now  be  smaller  than  in  A.  Hence,  the 
piobabilily  of  decision  erroi  is  small  with  unequal-size  displays  showing  huge  differences, 
as  it  ts  with  equal-size  displays,  because  both  components  of  the  mixture  dtstiibution  have 
the  same  (large)  positive  expectation. 

Divided  bars 

With  pies  the  observer  has  the  possibility  of  avoiding  the  coitLiadiclory  features  -  always 
attend  to  angle  or  slope  With  divided  bars  theie  is  no  way  out  If  the  bars  are  not  equal  in 
size,  as  at  bottom  right  in  Figure  2,  it  makes  no  chlleience  whether  the  obseivei  attends  to 
position,  length,  or  area  When  one  of  these  features  produces  a  contradictory  result,  so  do 
the  others 

Hence,  it  is  not  possible  to  disctiminate  the  pioportions  shown  in  unequal-size  divided 
bars  accurately  if  the  decision  ts  based  solely  on  perceptual  features.  Cognitive  operations 
are  needed  to  perform  the  task  accuiately.  We  propose  that  the  observer  perforins  a  ratio 
estimation  operation  (Hollands  and  Spence,  1992,  1998)  that  takes  as  input  the  length 
(or  aiea)  of  the  segment  and  the  length  (or  aiea)  of  the  whole  bar  The  mental  ratio  is  the 
observer’s  estimate  of  the  iatio  of  the  part  to  the  whole  (e  g.  33%). 

Mental  ratios  for  the  two  divided  bars,  A  and  B,  are  incorporated  into  the  model 
by  treating  them  like  stimulus  featuies.  In  the  absence  of  error,  a  comparison  of 
mental  latios  (A-B)  yields  the  correct  response,  ‘A>B’  while  attending  to  perceptual 
leatures  such  as  length  or  area  produces  a  negative  (A-B)  and  a  decision  enor.  In  the 
presence  of  error  an  asymmetric  difference  distubution  lesults  (similar  to  Unit  obtained 
willi  unequal-size  pies)  for  observers  who  use  perceptual  featuies  some  of  the  tune,  either 
voluntarily  or  involuntarily  As  with  pies,  the  likelihood  of  decision  enor  will  be  largei  and 
the  effect  of  varying  the  difference  in  proportions  should  be  mote  pronounced  with 
unequal  sizes 

Mental  ratios  aie  likely  to  be  less  accuiate  than  petceptual  features  Each  mental 
pioccssing  step  (exlimulmg  magnitudes  of  p.ut  and  whole,  and  estimating  then  iatio) 
introduces  a  potential  souice  ol  eiror  with  the  resulting  iatio  estimate  likely  to  be 
inaccurate  In  judgements  of  propoi tion  wait  similar  bar  graph  stimuli,  for  example, 
Hollands  and  Spence  (1998)  obtained  average  errots  of  ±3-5%  Therefore  we  shall 
assume  that  the  dtffetence  distribution  for  mental  ratios  has  higher  vartabjlify  than  for 
perceptual  features.  Observeis  will  be  moie  likely  to  eir  with  unequal-size  divided  bars 
than  with  unequal-size  pies,  where  relatively  accurate  perceptual  features  (such  as  angle  or 
slope)  are  always  available  In  addition,  the  piobabilily  of  a  decision  error  should  decrease 
with  difference  in  proportions  more  quickly  with  unequal-size  divided  bars  than  pies, 
because  of  the  greater  variability  in  the  difference  distributions  for  unequal-size  divided 
bais. 


Incremental  estimation  and  response  time 

In  many  real-woild  contexts  (eg  a  banker  studying  a  giaph  in  a  financial- repoit,  a 
physician  examining  a  graph  of  epidemiological  data  in  a  medical  journal),  the  reader  is 
not  under  strict  lime  pressuie  and  theie  will  generally  be  sufficient  time  to  discriminate  die 
proportions  shown  accurately.  Although  the  basic  elements  of  the  decision  process  may  be 
modelled  as  described  above,  we  do  not  think  that  the  observer  makes  only  one  estimate  of 
tlie  difference  using  only  one  peiceptual  feature.  Instead,  we  assume  that  the  observer 
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accumulates  mciemenlal  estimates  -  indexed  by  1/  -  and  computes  a  running  average  as  v 
increases  This  kind  ol  accumulation  pioccss  has  been  vised  in  the  past  to  model  RTs  m 
discrimination  tasks  (see  Peliusic,  1992  lor  a  review)  T  he  most  important  effect  of  the 
repeated  sampling  is  to  reduce  the  variance  of  the  averaged  difference,  ns  Figure  3 
illustrates  using  pic  charts  as  stimuli  If  the  observer  averages  the  incremental  estimates, 
the  variance  of  the  final  average  will  be  smaller  than  that  of  a  single  estimate  Indeed,  the 
variance  will  fall  as  v  increases  -  we  have  shown  the  standard  deviation  dropping  as  the 
square  tool  of  v,  as  it  would  with  independent  estimates  and  the  computation  of  a  naming 
mean 

The  repeated  sampling  will  also  symmetrize  a  skewed  distribution,  as  shown  in  the  right 
panels  of  Figure  3  The  sampling  distribution  tends  towards  symmetry  fairly  quickly,  in  the 
same  fashion  that  the  sampling  distribution  of  a  mean  tends  towards  the  Gaussian  by  the 
Central  Limit  Theorem.  This  has  the  effect  of  pulling  in  the  tail  of  the  distribution  and 
reducing  the  error  rate  Our  illustration  shows  only  a  small  degree  of  skewness  when  i/  =  2 
and  approximate  Gaussian  form  when  i;  =  4  The  repeated  sampling  has  an  especially 
important  consequence  when  there  arc  components  on  (he  ‘wiong’  side  ol  the  difference 
distribution  -  asymmetnes  should  quickly  be  reduced,  although  the  variance  of  the 
distribution  will  still  be  larger  than  otherwise 

When  the  graphs  are  of  unequal  size  the  model  predicts  a  higher  error  rate  than  for 
equal-size  graphs,  foi  any  value  of  v.  However,  if  the  observer  tries  to  match  some  internal 
error  criterion,  the  number  of  incremental  estimates  in  the  unequal-size  case  must  be 
greater  and  hence  the  RTs  should  he  longer  In  other  words,  the  number  of  incremental 
estimates  v  should  be  greater  in  the  unequal-size  case  than  in  the  equal-size  case  to  make 
the  error  rates  roughly  equivalent  For  example,  in  the  illustration  in  Figure  3,  four 
incremental  estimates  are  needed  in  the  unequal-size  case  to  achieve  the  same  level  of 
accuracy  obtained  with  two  incremental  estimates  in  the  equal-size  case. 

Similarly,  if  the  difference  between  the  proportions  is  made  smaller,  and  the  observer  is 
trying  to  match  the  same  internal  error  criterion  level,  RTs  should  increase.  Also, 
whenever  the  difference  distribution  exhibits  greater  variability,  for  whatever  reason,  we 
expect  the  observer  who  is  attempting  to  minimize  error  to  take  longer  That  is,  the  same 
predictions  we  have  made  for  error  should  be  seen  in  RTs  in  an  experiment  where  accuracy 
is  emphasized 

Evaluating  the  incremental  estimation  model 

Two  experiments  were  conducted  to  evaluate  specific  predictions  of  the  model  with 
divided  bar  graphs  and  pie  charts  Experiment  I  was  designed  to  investigate  the  effects  of 
alignment  and  difference  in  proportion  on  RTs.  In  Experiment  2  we  manipulated  overall 
size  and  difference  in  proportion  in  a  similar  manner.  In  both  our  experiments,  accuracy 
was  emphasized  to  the  participants  To  keep  accuracy  levels  high  over  multiple  trials,  we 
gave  participants  feedback  after  each  judgement. 

No  previous  experimental  work  has  examined  the  effects  of  alignment  and  size  on 
an  observer’s  ability  to  discriminate  proportions  shown  in  graphs  In  addition,  the 
incremental  estimation  model  makes  several  piediclions  that  other  models  in  the  graphical 
perception  literature  would  not  make  without  modification  Some  predictions  made  in 
Experiment  1  ate  consistent  with  Cleveland’s  (1985)  ranking  of  perceptual  features  but 
since  the  ranking  has  not  previously  been  applied  to  discrimination  judgements  it 
remains  untested  for  that  task  Moreover,  some  predictions  made  by  the  incremental 
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Figuie  3  An  illustration  ol  the  ellect  of  repeated  sampling  in  the  incremental  estimation  model  with 
equal  sizes  (Experiment  1)  shown  on  the  left  and  unequal  sizes  (Experiment  2)  shown  on  the  right. 
Note  that  error  decreases  with  repeated  sampling  and  that  the  disinflations  become  mote  symmetnc 
with  repeated  sampling  in  the  unequal-size  case 
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estimation  model  in  Experiment  2  aie  inconsistent  with  a  simple  application  of 
Cleveland's  ranking 


EXPERIMENT  1 

The  participant’s  task  in  Expeiiment  1  was  to  discriminate  between  (wo  piopoitions  shown 
in  graphs  Graph  type,  alignment,  and  difference  in  propoition  were  manipulated  RT and 
error  measures  were  obtained  Participants  were  instructed  to  be  as  accurate  as  possible, 
and  received  feedback  after  each  response  The  incremental  estimation  model  makes  the 
following  predictions 

Cl)  RTs  will  decrease  monotonically  as  the  difference  in  proportions  increases 

(2)  RTs  will  be  shoiter  with  aligned  than  non-aligned  segments. 

(3)  RTs  will  be  shorter  with  divided  bars  than  pies 

(4)  The  monotonic  decrease  in  RT  with  mucased  difference  in  propoi  dons  will  bogie, iter 
for  non-aligned  than  aligned  segments 

(5)  The  monotonic  decrease  in  RT  with  increased  difference  in  proportions  will  be  greater 
for  pies  than  divided  bars 

(6)  Similar  patterns  are  predicted  for  error. 

Picchctions  (2)  and  (3)  follow  from  Cleveland’s  ranking,  although  this  ordering  has  not 
been  previously  applied  to  discrimination  tasks  In  addition,  by  itself,  Cleveland’s  ranking 
does  not  specify  the  mechanism  by  which  errors  and  response  times  should  increase  or 
decrease. 


Method 

Participants 

Thirty-two  students  at  the  University  of  Toronto  participated  in  the  experiment.  They 
received  course  credit  for  their  participation 

Materials  and  apparatus 

Twenty  integer  proportions  were  randomly  generated  in  the  range  from  0  05  to  0  50  No 
proportion  was  within  2%  of  any  other  in  the  set. 

Each  of  the  twenty  proportions  was  paired  with  another  proportion  determined  by 
adding  0  01,  0  02,  0  04,  or  0  08  to  the  first  On  a  given  trial,  a  pair  of  proportions  was 
displayed  using  two  divided  bar  graphs  or  two  pie  charts  Figure  1  shows  examples  of  each 
graph  type  for  aligned  and  non-aligned  conditions.  The  left-right  position  of  the  larger 
proportion  was  randomized  over  trials  On  half  the  tnals  (the  non-aligned  condition)  one 
of  the  segments  (selected  at  random)  was  displaced  upwards  (or  rotated  clockwise) 
corresponding  to  a  proportion  of  0  30  Both  segments  were  displaced  from  the  base 
(divided  bars)  or  12  o'clock  position  (pics)  by  a  inndom  value 

The  height  of  each  divided  bar  was  80  min,  and  its  width  was  15  mm.  The  radius  of 
each  pie  chart  was  28  mm.  For  both  pies  and  divided  bars,  the  two  members  of  the 
pair  were  separated  by  a  100  mm  horizontal  distance  (centie  to  centre).  The  viewing 
distance  was  approximately  50  cm  All  graphs  were  white  on  a  black  background  The 
two  segments  representing  the  proportions  were  coloured  red.  The  graphs  were  shown 
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on  a  30  cm  display  (meastued  diagonally)  at  640  x480  (horizontal  by  veitical) 
resolution,  controlled  by  a  piogiam  tunning  on  an  IBM  peisonal  computer,  which  also 
measuied  RTs 

Design  and  procedure 

A  2x2x4  (Graph  Type  by  Alignment  by  Difference  in  Propoittons)  wilhin-subjects 
design  was  used  The  two  giaph  types  were  divided  bar  giaphs  and  pie  charts,  the 
segments  were  drawn  aligned  or  non-aligned,  and  the  dilfetences  in  propot  lion  were  0  01, 
0.02,  0.04,  and  0  08  The  order  of  trials  was  randomized  willun  each  of  the  16  conditions, 
and  the  order  of  conditions  was  counterbalanced  across  participants  using  Latin  squares. 
Thete  were  20  trials  per  condition  for  a  total  of  320  trials  per  participant 

Participants  were  told  that  they  would  be  shown  pairs  of  graphs,  and  that  their  task 
would  be  to  indicate  which  pioportion  was  larger  Participants  piessed  the  left  key  (the  ‘  1  ’ 
key  on  the  numeric  keypad)  when  the  left  propoition  was  laigei,  and  the  light  key  (the  ‘2’ 
key)  when  the  right  proportion  was  laiger. 

Participants  were  provided  with  feedback  after  each  trial;  the  computer  produced  a  high 
tone  for  a  correct  response,  and  a  losv  tone  toi  an  incouect  lesponse.  They  were  instructed 
to  be  as  accuiate  as  possible,  and  to  take  as  much  time  as  they  needed.  Participants  were 
debriefed  at  the  end  of  the  expel  imental  session.  The  expenment  requited  approximately 
40  minutes  to  complete.  To  minimize  learning  ellects  during  the  experiment,  participants 
completed  64  practice  trials  beforehand. 

Results 

Data  horn  three  new  paiticipants  teplaced  the  data  tor  tin ee  paiticipants  who  pioduced 
moie  than  40%  errors  in  one  or  more  conditions.  Foi  each  participant,  the  median  RT 
for  cotrect  trials  in  each  condition  was  computed,  and  the  means  of  these  medians 
(averaged  across  participants)  are  shown  in  Figure  43  A  2x2x4  (Graph  Type  by 
Alignment  by  Diflciencc  in  Pi opoi  lions)  wilhin  suh|oc  is  analysis  of  valiant  e  ( ANOVA| 
was  peiloimed.  We  also  peiloimed  a  liend  analysis  to  deleiminc  d  the  changes  in  RT 
with  difference  in  propoition  were  monotonic  RTs  decreased  linearly  as  the  difference 
in  proportion  increased,  F{\, 31)  =  73  13,  MSe  —  2  16,  p<00001.4  There  was  no 
evidence  for  a  quadratic  or  cubic  trend  (both  ps  >  0  05).  RTs  were  shoiter  when 
segments  weie  aligned,  F(l,31)  =  28  11,  /V/Se  =  0  57,  p  <00001  RTs..were  shorter 
with  divided  bars  than  pies,  A(l,3  1)  —  25.60,  MSe  =  1  35,  p  <  0  0001  Tests  for  differ¬ 
ences  in  linear,  quadratic,  and  cubic  trends  as  determined  by  graph  type  and  alignment 
were  carried  out  (see  Keppel,  1982,  pp  232-234)  The  linear  decrease  in  RT  with 
difference  in  proportion  was  greater  for  non-aligned  than  aligned  segments, 
/•"(  1,31)  =6  89,  MSe  =0.33,  /i<0  05.  The  lineai  decrease  in  RT  with  difference  in 
proportion  was  also  greater  for  pies  than  divided  bars,  F(  1 ,3  1 )  =  5  37,  A7.S'e  =  0  83, 
p  <  0  05  There  was  no  evidence  loi  interactions  having  quudiaiic  or  cubic  components 
(yjs  >  0.50) 


3If  RTs  foi  erior  trials  were  included,  die  same  general  pattern  was  obtained  1  Ins  was  Hue  lor  both  experiments 
JTo  correct  for  violations  of  sphericity  and  homogeneity  ol  vai  uince,  a  Geisser— C Jreenliouse  adjustment  was  used 
for  bolh  experiments  After  adjustment,  all  reported  ellecls  fiom  analyses  ol  variance  are  associaled  with  p-values 
less  Ilian  0  05  However,  unadjusted  degrees  of  freedom  and  values  aie  lepoiled  in  the  lexl  to  suupldy 
exposition 
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Difference  In  Proportions 


Figure  4  Experiment  1  results  Top  mean  RTs  for  correct  trials,  as  a  function  of  graph  type, 
alignment,  and  difference  in  proportions  Bottom-  proportion  of  trials  in  which  participants  made  an 
error  Error  bars  indicate  the  standard  error  of  the  mean 


Errors  occurred  on  8%  of  the  trials  on  average  and  they  tended  to  occur  in  those 
conditions  in  which  participants  produced  the  longest  RTs  The  lower  part  of  Figure  4 
shows  the  mean  error  data 


Discussion 

The  predictions  of  the  model  were  supported  Participants  took  less  time  with  larger 
differences  in  proportion  (because  the  expected  value  of  the  difference  distribution  was 
located  farther  from  the  criterion),  and  the  decrease  in  RT  was  monolomc  Participants 
took  longer  with  pie  charts  than  divided  bars  (because  the  perceptual  features  available 
with  divided  bars  ranked  higher  in  the  Table  1  hierarchy  than  those  available  with  pies, 
leading  to  smaller  variability  in  the  difference  distiibution).  Participants  took  longer  with 
non-aligned  segments  (because  a  higher-ranking  perceptual  feature  was  lost  when 
segments  were  not  aligned,  leading  to  greater  variability  in  the  difference  distribution). 
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RTs  for  non-aligned  propot  Hons  decreased  more  tapidly  as  lire  ditieience  in  propoition 
was  incieased  (because  of  lower  vanability  m  ihe  dilfeience  dislnbution  for  aligned 
segments).  Finally,  RTs  decreased  moie  lapidly  loi  pies  than  divided  bats  as  the  ditieience 
in  ptopoitions  was  increased  (because  of  lower  variability  in  the  difference  distribution  for 
divided  bars). 

The  error  data  were  in  appioxunate  coirespondence  with  the  RTs,  consistent  with  the 
model’s  piediction  that  RTs  and  errois  should  be  conelated 


EXPERIMENT  2 

In  Experiment  2,  giaph  type,  size,  and  difleience  in  pioportion  were  iiianipulaled  and  RT 
and  erroi  measuies  were  obtained  Paitieipanls  weie  mstiucted  to  be  as  accurate  as 
possible  and  received  feedback  after  each  1  espouse  The  incremental  estimation  model 
makes  the  following  predictions 

(1)  RTs  will  decrease  monotonically  as  the  difleience  in  proportions  increases. 

(2)  RTs  will  be  shorlei  with  equal  than  unequal  sizes. 

(3)  With  unequal  sizes,  divided  bars  will  pioduce  longer  RTs  than  pies,  but  with  equal 
sizes,  the  reverse  will  occur. 

(4)  The  monotomc  decrease  m  RT  with  increased  difference  in  proportions  will  be  greater 
for  the  unequal  than  equal-size  case 

(5)  For  the  unequal-size  case,  the  monotomc  decrease  in  RT  with  increased  diffeience  in 
proportions  will  be  greater  for  divided  bais  than  pies. 

(6)  For  the  equal-size  case,  the  monotomc  decrease  in  RT  with  increased  difference  in 
proportions  will  be  greater  for  pies  than  divided  bats. 

(7)  Similar  results  are  piedicted  for  error 

A  simple  application  of  Cleveland's  ranking  pi  edicts  that  divided  bats  should  generally 
pioduce  hetlei  peilomi.mcc  than  pies,  siikc  position  on  a  common  scale  can  be  pulged 
with  divided  bars,  but  observers  can  only  use  slope  oi  angle  with  pies  Thus,  Cleveland's 
ranking  is  in  accord  with  the  second  pad  of  piediction  (3)  (that  divided  bars  should 
produce  better  pertoimance  than  pies  for  the  equal-size  case),  but  contrary  to  the 
incremental  estimation  model,  would  predict  the  same  lesult  for  the  unequal-size  case 
(the  first  part  of  prediction  (3)) 

Method 

Thirty-two  University  of  Toronto  students  seived  as  participants.  They  received  course 
ciedit  for  their  participation  Experiment  2  had  a  2  (graph  type)  x  2  (size:  equal-size  or 
unequal-size)  x  4  (difleience  m  piopoitions)  wilhm-subjects  design  The  stimuli  and 
procedure  were  the  same  as  in  Experiment  1  with  the  following  differences  On  halt  the 
tuals  (the  unequal-size  condition)  the  height  of  one  divided  bar  (or  radius  of  one  pie)  was 
60%  of  the  other  Hence,  a  small  divided  bai  was  48  mm  m  height,  a  small  pie  ehait  had  a 
17  mm  radius  For  the  other  half,  the  sizes  wete  equal.  Each  of  the  twenty  propoitions  in  a 
condition  was  paired  with  another  proportion  deteinuned  by  adding  0.04,  0  08,  0  16,  or 
0  32  to  the  first.  The  difference  in  proportions  was  increased  to  keep  error  trials  few  and 
RTs  in  the  same  range  as  they  weie  m  lixpei  iiiieni  1  Paitieipanls  weie  msliucted  to  |udge 
the  lelative  proportions,  rather  than  absolute  sizes,  m  the  unequal-size  condition. 
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Difference  In  Proportions 

Figure  5  Experiment  2  results  Top  mean  RTs  for  correct  trials,  as  a  function  of  graph  type,  size, 
and  difference  in  proportions  Bottom  proportion  of  trials  in  which  participants  made  an  error  F.rror 
bars  indicate  the  standard  error  of  the  mean 


Results 

Data  from  two  new  participants  replaced  the  data  for  two  participants  who  produced  more 
than  40%  errors  in  one  or  more  conditions  For  each  participant,  the  median  RT  for  correct 
trials  in  each  condition  was  computed,  and  the  means  of  these  medians  (averaged  across 
participants)  are  shown  in  Figure  5  A  2x2x4  (Graph  Type  by  Size  by  Difference  in 
Proportions)  within-sub|ects  analysis  of  variance  (ANOVA)  was  performed  on  the 
medians  A  trend  analysis  was  also  performed,  as  in  Experiment  1  RTs  decreased 
monotomcally  (with  significant  linear  and  quadratic  components)  as  the  difference  in 
proportion  increased  (/•’(  1 ,3  I )  —  40  3,  MSC  =  2.50,  /><(). 0001  for  linear,  /’( t  ,3  I )  =  4  9 1 , 
MS,.  -  0  32,  /;  <  0  05  for  quadratic)  There  was  no  evidence  for  a  cubic  component 
(p>  0.15)  RTs  were  shorter  with  etpial  sizes  than  unequal  sizes,  F(  1 ,3 1 )  =  29  36, 
MSe  —  3  87,  p<  0  0001  Divided  bars  produced  longer  RTs  than  ptes  in  the  unequal- 
size  case,  but  in  the  equal-size  case,  the  reverse  occm  red,  F(I,3I)=  13  7,  MSe  =  3  40, 
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p  <  0  001  The  linear  decrease  in  RT  vviili  incieased  diftcrence  in  propoitions  was  gieater 
lor  die  unequal  Ilian  the  equal-size  case,  /•'(  1 , 3  1 )  =  14  60,  A/6\.  —  2  1  1 ,  p  <  0  00 1  (Quad¬ 
ratic  and  cubic  components  weie  not  significant,  p  >0.25.)  Thus,  predictions  (1)  to  (4) 
weie  suppoited 

As  the  diffeience  in  piopoitions  was  incieased,  the  rates  ol  linear  decrease  for  equal  and 
unequal  sizes  wete  different  for  the  giaph  types,  with  the  rates  converging  more  quickly 
foi  divided  bars  than  pies,  F(  1 ,31)  =  8  06,  A/Se  =  2  12,  p  <  0  01  An  interaction  compar¬ 
ison  (Keppel,  1982,  pp  232-234)  showed  that  the  linear  decrease  in  RT  with  an  incieased 
difference  m  propoition  occurred  at  a  faster  rale  with  unequal-size  divided  bars  Ilian 
unequal-size  pies,  /r(l,31)  =  7  87,  MSe  —  4  15,  /;<0  01,  supporting  piediction  (5)  The 
same  analysis  applied  to  equal-size  graphs  showed  that  the  linear  decrease  in  RT  with 
increased  ditfeience  in  proportion  did  not  ddfer  between  divided  bars  and  pies, 
F(  1 ,3 1 )  =  0  36,  MSC  =  0  06,  p  >  0.60  Hence,  the  ellect  of  graph  type  and  difference 
in  proportions  appeared  lo  be  additive  with  same-size  graphs,  inconsistent  with  prediction 
(6)  There  was  no  evidence  for  quadratic  or  cubic  components  to  the  mtei action  between 
size  and  difference  in  proportions  for  either  graph  type  (all  ps  >0  15). 

Errors  occurred  on  3%  of  the  trials,  on  average  Conditions  in  which  participants 
produced  the  longest  RTs  pioduced  the  most  eriors  Inspection  of  Figure  5,  which  shows 
the  mean  erroi  data  for  each  condition,  shows  a  similar  pattern  lor  the  error  data  in 
accordance  with  prediction  (7).  In  addition,  it  is  apparent  that  the  error  for  equal-size 
divided  bars  stayed  relatively  constant  as  the  difference  in  proportions  increased,  but  error 
decreased  gradually  for  equal-size  pies 


Discussion 

The  model  predicted  that  RTs  should  decrease  monotomcally  when  the  difference  in 
proportions  was  larger  (because  the  difference  distribution  should  be  farther  from  the 
criterion).  The  model  predicted  longer  RTs  for  unequal  sizes  than  for  equal  sizes  (because 
(he  asymmctiic  distiihulions  icqiuie  moic  me  icuiculal  estimates  lo  mmmii/c  derision 
enor)  With  unequal-size  divided  bars,  where  dnect  use  ol  peiceplual  leatures  is 
unreliable,  observeis  must  compute  mental  ratios,  increasing  RTs  relative  to  unequal- 
size  pies  where  perceptual  features  of  angle  or  slope  yield  the  correct  response.  The  results 
were  consistent  with  these  predictions 

The  model  predicted  that  equal-size  divider!  bars  would  produce  shot  ter  RTs  than  equal- 
size  pies.  This  is  because  the  peiceplual  lentuies  that  can  be  used  with  divided  bais 
(position  along  a  common  scale,  length,  and  area)  rank  higher  on  aveiage  than  those  that 
can  be  used  with  pies  (slope,  angle,  and  area)  Thus  variances  in  the  difference 
distributions  in  our  model  should  be  smaller  lor  divided  bars  than  for  pies  The  lesulls 
were  consistent  with  this  prediction 

The  model  predicted  that  the  monotonic  decrease  m  RT  with  increased  ddference  m 
pioportions  should  be  greater  for  the  unequal  than  equal-size  case.  The  piobability  of  an 
error  is  larger  with  an  asymmetric  distribution  and  should  decrease  more  rapidly  as 
difference  in  propoition  is  increased.  This  should  lead  to  11011-additivity  in  size  and 
difference  in  propoition  for  the  RTs.  This  piediction  was  supported. 

It  was  predicted  that  the  effects  of  giaph  type  and  dillerence  m  piopoi lions  should  be 
uon-additive  in  the  unequal-size  case,  since  mental  latios  should  produce  greater 
variability  in  the  diffeience  distubulions  than  slope  ot  angle  leatures,  and  the  probability 
of  an  error  decreases  more  quickly  with  greater  variability  in  the  difference  distnbutions 
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'I  lie  results  supported  this  prediction  A  similar  piediction  foi  I  lie  equal-size  case  was  not 
suppoitcd  by  the  RT  data  although  die  error  data  vveie  consistent  with  (he  prediction 
The  lesults  support  our  assumption  that  observers  sample  from  the  set  of  available 
perceptual  featuies  rather  than  choosing  (be  most  effective  perceptual  feature  and  using  it 
consistently.  If  an  observer  only  paid  attention  to  slope  we  should  expect  to  see  no 
difference  in  performance  between  unequal-  and  equal-size  pies  The  data  do  not  support 
this  Instead  performance  was  worse  with  unequal-size  pies  than  with  equal-size  pies 
suggesting  that  observers  sample  from  the  set  of  available  features  (slope,  angle,  area) 
With  unequal-size  pies  this  strategy  will  lead  to  an  asymmetric  difference  distribution  with 
a  correspondingly  larger  variance,  increasing  decision  error  and  thereby  RT  This  result 
supports  a  coie  assumption  of  the  incremental  estimation  model 


GENERAL  DISCUSSION 


A  common  graph  reading  task  involves  the  disci  immalion  of  qii.mlilics  shown  m  giaphs 
Real-world  data  are  often  depicted  m  proportion  or  percentage  form  -  most  typically  m 
pie  charts  and  divided  bar  graphs  The  psychological  processes  that  people  use  to 
discriminate  proportions,  and  how  the  efficiency  of  those  processes  is  affected  by  factors 
such  as  alignment  and  size,  have  not  been  previously  examined.  In  this  paper,  we  have 
proposed  an  incremental  estimation  model  to  account  for  how  people  discriminate 
proportions  shown  in  graphs  and  successfully  tested  the  model’s  predictions  in  two 
experiments 

According  to  the  model,  the  observer  samples  from  the  difference  distribution  (A-B) 
and  produces  a  response  of  ‘A  <  B-  or  ‘A  >  B’  The  model  proposes  that  the  position  of  the 
distribution  is  determined  by  the  difference  between  proportions,  and  that  its  spread  is 
determined  by  the  relative  effectiveness  of  the  perceptual  features  available  Finally,  the 
model  proposes  that  the  shape  of  the  difference  distribution  (symmetric  or  asymmetric) 
will  depend  on  whether  the  graphs  are  the  same  size  or  not  With  unequal-size  graphs, 
when  more  of  the  distribution  is  on  the  ‘wrong’  side  of  the  criterion,  errors  are  more 
probable.  An  observer  may  minimize  error  by  increasing  the  number  of  incremental 
samples,  which  should  increase  RTs  in  situations  wheie  accuracy  is  stressed. 

The  model’s  predictions  were  tested  in  two  experiments  In  Experiment  1,  participants 
were  shown  pairs  of  equal-size  pies  and  divided  bars.  The  segments  were  aligned  or  non- 
aligned  and  the  difference  in  proportions  shown  was  varied  RTs  and  errors  were  recorded 
Accuracy  was  stressed  and  participants  received  feedback  after  each  trial.  The  model 
made  six  specific  predictions,  all  of  which  were  supported 

In  Experiment  2,  equal-  and  unequal-size  graphs  were  used  Graph  type  and  difference 
in  proportion  was  varied  Six  of  the  seven  predictions  made  were  supported  by  the  RT  data 
Although  there  was  little  support  for  the  prediction  that  the  RT  difference  between  same- 
size  pies  and  divided  bars  would  be  greater  with  smaller  differences  in  proportion,  the 
pattern  of  error  data  was  consistent  with  the  hypothesis 


Conclusions 

The  results  from  Experiment  2  suggest  that  a  simple  application  of  Cleveland’s  (1985) 
hierarchy  of  perceptual  features  is  not  always  appropriate  to  explain  performance  For 
example,  Cleveland  would  rank  divided  bars  above  pies  because  an  observer  can  judge 
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position  along  a  common  scale  will)  divided  bars  but  must  judge  slope  or  angle  with  pies. 
Our  results  show  that  there  is  not  always  an  advantage  to  the  divided  bai.  The  inciemental 
estimation  model  piovides  a  better  account  because  it  piesumes  that  several  dilTeienl 
perceptual  features  may  be  used  -  an  observer  will  sample  from  the  available  set.  Our 
model  accounts  for  differences  in  accuracy  by  assuming  that  the  spread  of  the  difference 
distribution  in  proportions  vanes  with  the  peiceptual  featuies  sampled  and  also  by 
assuming  that  observers  make  multiple  incremental  estimates  befoie  coming  to  a 
judgement  The  model  assumes  that  observers  sometimes  attend  to  featuies  that  yield 
inconect  judgements,  thus  reducing  accuiacy  and  increasing  tune  to  respond  This 
assumption  was  validated  in  Expeiiment  2.  In  conditions  where  perceptual  featuies 
cannot  provide  the  necessary  information,  the  model  proposes  that  mental  ratios  (derived 
quantities)  are  computed.  The  use  of  mental  latios  incurs  a  considerable  cost  in  terms  of 
processing  time  Features  that  make  equal-size  divided  bars  effective,  such  as  length  or 
position  on  a  common  scale,  are  not  useful  in  the  unequal-size  case.  Participants 
pei formed  more  poorly  with  unequal-size  divided  bars  than  they  did  with  pies  in 
Experiment  2. 

The  discrimination  of  pioportions  in  graphs  cannot  be  considered  a  simple  process  in 
which  an  observer  uses  a  single  stimulus  feature  One  might  expect  that  an  observei  would 
choose  the  most  effective  perceptual  feature  in  a  giapli  and  use  that  feature  consistently 
However,  our  results  suggest  that  observei  s  do  not  do  this  Although  perceptual  features 
such  as  area,  length,  or  position  cannot  be  the  basis  lor  accurate  discrimination  with 
unequal  sizes,  they  appeal  to  be  used  nonetheless  It  is  difficult  for  an  obseiver  to  ignore 
stimulus  featuies,  such  as  aiea,  that  aifoid  efficient  discrimination  in  some  cases 
(eg  equal-size  pie  charts)  but  impair  piocessing  in  olhei  situations  (eg  unequal-size 
divided  bars) 

Practical  implications 

The  di.scmnmation  ol  quantities  shown  in  giaplis  is  one  ol  the  most  common  tasks  giapli 
leaders  peilonn  (Gillian  and  Lewis,  1994).  Theielore,  it  is  important  that  graphs  be 
designed  to  make  it  easy  for  people  to  do  this. 

Usually,  when  a  senes  of  divided  bars  oi  pies  shows  proportions  over  time,  correspond¬ 
ing  segments  are  not  aligned  because  other  segment  sizes  have  changed.  Our  results  show 
that  when  segments  are  not  aligned,  the  discrimination  of  proportions  is  slowed,  especially 
with  small  differences  in  proportion  Divided  bars  are  faster  than  pies,  regaidless  of 
alignment,  and  this  advantage  is  largest  with  small  differences  in  proportion. 

Proportions  are  often  shown  with  dtfferent-size  graphs  to  show  variation  in  total  amount 
and  this  may  lead  to  difficulties  for  the  reader  For  example,  Shama  Twain  may  sell  fewer 
total  CDs  than  Celine  Dion  but  Twain  may  have  a  laigei  propoilion  of  sales  in  her 
lespective  market  (country)  than  does  Dion  in  heis  (adult  conteinpoiary).  When  such  data 
are  graphed,  our  study  shows  that  it  is  more  time-consuming  to  discriminate  two 
propoitions  with  respect  to  different  wholes  (total  country  sales  vs.  total  adult  contem- 
poi ary  sales),  especially  if  the  two  propoitions  ate  of  stinilai  magnitude  The  disadvantage 
is  less  pronounced  with  pies  than  divided  bais  For  same-size  giaplis,  however,  the 
advantage  appears  to  belong  to  the  divided  bar  format 

Thus  if  a  senes  of  graphs  depicting  proportions  or  percentages  consists  of  equal-size 
wholes,  divided  bars  aie  pieferred  If,  however,  the  wholes  are  of  unequal  size,  a  senes  of 
pies  is  the  better  choice 
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